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ARSTRACT 

We  consider  simultaneous  confidence  regions  for  some 
hypotheses  on  ratios  of  the  discriminant  coefficients  of  the 
linear  discriminant  function  when  the  population  means  and 
common  covariance  matrix  are  unknown.  This  problem,  involving 
hypotheses  on  ratios,  yields  the  so-called  'pseudo'  confidence 
regions  valid  conditionally  in  subsets  of  the  parameter  space. 

We  obtain  the  explicit  formulae  of  the  regions  and  give  further 
discussion  on  the  validity  of  these  regions.  Illustrations  of  the 
pseudo  confidence  regions  are  given. 


1 .  INTRODUCTION 


The  linear  discriminant  function  based  on  the  vector  of 
measurements  x  =  (x.j  .Xj,  •  • .  ,x  )'  for  discriminating  two  p- 
variate  normal  populations  with  mean  vectors  and  and 


common  nonsingular  covariance  matrix  T, 


lo  given-by  -a*Tt  where-- 
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a  *  (a. ,a. , . . .  ,a  )'  *  E  *(>i,  -  tu)  is  the  vector  of  discriminant 

-  l  2  p  '1-2 

coefficients.  Only  the  ratios  of  the  discriminant  coefficients 
are  uniquely  determined  In  the  discriminant  analysis.  In  this 
paper,  we  shall  investigate  simultaneous  confidence  regions  for 
some  hypotheses  on  the  ratios,  when  the  population  means  and 
covariance  matrix  are  unknown. 

The  problem  is  reduced  to  using  a  likelihood  ratio  P  test 
statistic  in  the  derivation  of  simultaneous  confidence  regions. 
This  procedure  gives  a  number  of  multidimensional  regions  of 
different  shape,  the  so-called  ’pseudo*  confidence  regions  valid 
conditionally  in  subsets  of  the  parameter  space.  The  terminology 
’pseudo’  confidence  region  is  due  to  Ogawa  (1977),  We  obtain  the 
explicit  formulae  of  our  confidence  regions.  We  focus  our  dis¬ 
cussion  on  the  bounded  pseudo  confidence  regions  and  consider 
the  conditions  for  the  validity.  The  meanings  of  the  required 
conditions  are  clarified  from  the  practical  point  of  view  in 
connection  with  problems  of  testing  hypotheses.  Illustrations 
of  the  pseudo  confidence  regions  are  given. 

It  may  be  worthwhile  to  list  some  literature  on  the  problem 
of  confidence  regions  for  ratios  of  (components  of)  normal  pop¬ 
ulation  means.  The  univariate  case  has  been  considered  by  Creasy 
(1954),  Fieller  (1954),  James,  Wilkinson  and  Venables  (1974)  and 
Ogawa  (1977).  Box  and  Hunter  (1954),  Roy  and  Potthoff  (1958), 
Zerbe  (1978)  and  Chikuse  (1980)  Investigated  the  multivariate  . 
case.  The  tests  and  confidence  regions  for  hypotheses  on  ratios 
of  discriminant  coefficients  were  considered  by  Fisher  (1940), 
Kshlrsagar  (1963)  and  Rao  (1970a,  Chapter  7),  (1970b).  This  paper 
gives  further  considerations  in  this  area. 

2 .  PRELIMINARY  RESULTS 

We  consider  the  multivariate  linear  hypothesis  on  the  dis¬ 
criminant  coefficients 

B  a  *  0,  (2.1) 

where  B  is  a  k  x  p  matrix  with  linearly  independent  k  rows, 
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k  *  l,  p  >  k.  The  following  lemma  is  fundamental  for  the  sub¬ 
sequent  discussion. 


Lemma  2.1.  The  hypothesis  (2.1)  is  equivalent  to  the  hypothesis 

that  the  coefficients  of  z  ,  i  =  1 ,2, . . . ,k,  in  the  discriminant 

function  based  on  new  variables  z  ■■  (z, ,z„,...,z  )'  are  zero, 

12  p 

where 


i  * 


k 

,-l 

11 


p-k 


0 


-OCj  b.,)*  t  . 

11  12  p-k 


p-k 


k  p-k 

,  K  -  f Bj j  B12  ]  k.  (2.2) 
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Here  is  assumed  to  be  nonsingular  without  loss  of  generality 

and  hence  T  is  nonsingular. 

The  null  hypothesis  that  some  of  the  discriminant  co¬ 
efficients  are  zero  is  tested  by  the  well  known  likelihood  ratio 
F  test  statistic  (see  e.g.,  Kshlrsagar  (1972,  p.  200)).  Given 
samples  of  sizes  n}  and  n2  from  the  two  normal  populations 
concerned,  we  apply  this  result  to  our  problem. 

Lemma  2.2.  The  100(1 -a)  per  cent  confidence  region  for  the 
parameters  satisfying  the  null  hypothesis  (2.1)  is  given  by 

\  -  Bk  (Ld)  '  (LSL*)-1  (M)  <  0,  (2.3) 

where 

l- K-«-;  »12)'  >p_ki. 

d;  the  difference  of  sample  means. 


S;  the  sum  of  the  corrected  ss  and  sp  matrices 


(2.4) 


°V  “  c  d  S  d  -  k(f-p+l)  Fk>f.|-.1(«), 


8k  -  e!|Mt-pM)'1F|ii|.|>t|l«)  +  11, 


f  *  ni  +  n2  ~  2,  c  =  +  n2>, 


and  F,  -  . (a)  denotes  the  upper  100a  percentile  of  the 

k f  r-p t 1 1 


F  .  distribution  with  degrees  of  freedom  k  and  f-p+1. 

K  n  I  “pi  1 


In  the  subsequent  sections,  we  shall  investigate  some 
hypotheses  on  the  ratios  which  are  expressed  in  the  form  (2.1). 


3.  AN  AS STONED  RATIO  OF  TWO  COEFFICIENTS 


For  the  hypothesis  Hj :  a^/a2  **  P.  the  L  matrix  in  (2.4) 
is  given  by  1,^  =  ff,T  where  F  =  (p,0, , . .  ,0)  * .  We  obtain 
after  some  algebra  and  simplification. 


(L1d)’(l.1SLp-1aid)  -  |L1S!,;;rJ[|S(2.2)|dJ2)s'^2  d(2)0 


.1-1, 


.-1 


+  2IS(1*2)I-(2)S(1*2)-(1)P 


+  lS(l*l)l-(l)S(l«l)-(l),» 


(3. 


where 

IhjSLlI  =  |s(2>2)|p  +  2|s(1.2)|p  +  I S(1-1) I  * 

and  S,.  .  ,  .  .  and  d,  .  .  denote  res- 

vlj » •  •  •  *  1k*3  ■}  *  *  *  *  *  J  ^ 

pectively  the  matrix  obtained  from  S  by  deleting  the 
ij,...,i^  th  rows  and  the  tli  columns  and  the  vector 

obtained  from  d  by  deleting  the  ij,...,i^  th  components. 
Substituting  (3.1)  into  (2. 3) gives  the  confidence  region  for  p 


*“1  2 

g(p)  =  is(2.2)^al  ~  ~<2)S(2  *2)~  (2) 


+  2|s(l>2)|[a1  -  ^2S<l-2>~ (l>lp 


+  -  «1  -(i)sa-i)-(i)'  i°- 


(3.2) 


Cj  ■  I S2 . 2  ^ ^al 


P1  -(2)S(2»2)-(2)*’  and 


D1  “lS(l-2)l  [a]  "  S1  ~(2)S(1»2)-(1)^ 


0.3) 


"  *s(i-i)'lai  "  h  -(i)s(i-i)d(i)]’ 


(the  discriminant  of  the  quadratic  form  g(p))  and  let  and 

r2  denote  the  real  roots  of  g(p)  =  0  (r^  <  r2),  if  they  exist, 

then  the  confidence  region  may  be  given  by 

Condition  >  0  and 

(i>‘  r,  <P£ 

1  Condition  IIV  '  :  Dt  >  0, 


(ii)  p  <  Tj  or  p  >  r2>  if  C^  <_  0  and  >  0, 


(3.4) 


(ill)  -  »  <  p  <  o°,  if  C^  <_  0  and  <_  0. 


We  may  be  most  interested  in  the  case  (i),  i.e.,  when  the  con¬ 
fidence  region  is  bounded.  Taking  into  account  a  similar  pro¬ 
cedure  for  1/p  shows  that  only  the  case  (ill)  may  be  an  un- 
desired  situation,  in  which  case  the  value  of  p  can  not  be 
definitely  defined  and  the  whole  real  line  represents  the  con- 
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fidence  region.  The  implication  of  the  Conditions  i  and 
are  clarified  in  tlu*  following: 


I.emma  3.1.  1)^  in  (3.3)  is  simplified  as 


Di "  dsHsa.2.i,2)l(“i  -  Bi 


"  B1  ~(1,2)B(1,2*1,2)~(1,2)^’ 


(3.5) 


for  which  we  must  show  the  following  equalities: 


lS(l-2)l  ”  i^1  =  "lS^S(l,2  1,2)1 


(3.6) 


2  2 

1"1  lS(i*i)'  ^  '(j)S(j*J)'(J)  "  2^(l-2)l  -(2)S(1*2) ~(1) 


*S^S(1,2.1,2)I  [^*S  ^  +  ~(1,2)S(1, 2-1, 2)^(1, 2)1*  (3’7) 


*S(1*2)I  [-(2)S(l‘2)'(l)]  lS(i*i)^(i)S(i-i)-(i) 


■lSl I S(1 ,2-1,2) ^’S  ~  ~(1,2)S(1,2*1,2)*(1,2)*  (3-8) 


Proof.  Those  equalities  are  proved  by  some  lengthy  but  straight¬ 
forward  algebra,  and  hence  the  proof  is  omitted  here. 

It  is  shown  from  (3.5)  and  the  fact  a,  -  B.  d'S  *d  <  0 
(1)  K  K 

that  the  Condition  IIV  '  is  equivalent  to  -  0^  d^  2) 

S~,}  „  .  ,,d„  >  0.  It  is  well  known  that  the  Mahalanobis’ 

(1*2*1, 2) ~ (1,2) 

distance  is  an  increasing  function  of  the  number  of  measurements 
involved.  Hence  the  Condition  1^:  ~(2)^(2*2) ~ (2)  >  ® 


implies  the  Condition  II 
We  summarize  in 


Theorem  3.1.  The  lOO(l-a)  per  cent  confidence  region  for 

p  ■  a, /a,  is  given  by  (3.2).  Especially  this  defines  a  hounded 

1  1  (1) 
interval  on  the  real  line,  if  the  Condition  T  : 

-  ^2^(2)^(2*2)~  (2)  >  ®  is  sat i s fled .  The  Condition  11^^: 

a,  -  8.  d',,  ..si  _  ,  ,.d„  >  0  is  the  condition  for  the 

1  1  *(1,2)  (1,2*1, 2)- (1,2) 

confidence  regLon  not  to  be  the  whole  real  line.  These  con¬ 
ditions  define  acceptance  regions  for  the  tests  of  hypotheses 
/  0,  and  f  0  or  t  0  respectively.  These  hypotheses 
are  the  conditions  for  the  existence  of  the  bounded  and  definite 


values  of  the  ratio  a^/a2. 


The  actual  (conditional)  confidence 


coefficients  for  these  pseudo  confidence  regions  are  given  by 
the  probabilities  of  (3.2)  conditional  on  those  conditions. 
However,  the  probability  of  the  conditions  approaches  one  under 
'reasonable  circumstances '  in  most  practical  situations,  and 
hence  the  bounded  confidence  region  occurs  with  the  confidence 
coefficient  approximately  equal  to  1-n  with  probability  one  in 
'reasonable'  practical  situations. 

The  problem  of  pseudo  confidence  regions  which  are  con¬ 
fidence  regions  for  some  parametric  functions  valid  conditionally 
in  subsets  of  the  parameter  space  is  rigorously  discussed  by 
Chikuse  (1980)  especially  in  connection  with  a  multivariate  linear 
functional  relationship. 

4.  ASSIGNED  RATIOS  OF  SEVERAL  COEFFICIENTS:  CASE  T 


For  the  hypothesis  H^:  ai^aic+i  =  a2^ak+l  =  P2' 


Vvi 


(k  >  2),  the  L  matrix  in  (2.4)  is  given  by 


L  =  [ r  , r  ..... r  ,  T  ],  where  P .  =  (p  ,0, . . . ,0) ' , 

4  ^  1  *”  K  P”R  I  1 

i  =  l,...,k.  Some  algebra  similar  to,  but  more  complicated 
than  that  for  the  hypothesis  yields  the  following  results. 
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a. 


2i)'(L2SL’)'1(L2d)  =  B11P^ 


i  -1  k 

31  •  ‘  f  V 


k  k 

+  2  >:  Bop  +  2  r  Bp  +  b  1,  (4.1) 

1.1=1.  i<1  1.1  1  J  1=1  1  1  0 


where 


'W  -  A  *.i-^  *  *  AuVi +  2  ,i,  Vi +  v 


and,  putting  T  =  (l,2,...,k). 


Ali  “  ^S(J-{l},k+W-{  l),k+l)^  * 


B11  All''(J-{l),k+l)S(J-(  t),k+l-J-(  i),k+l)-(J-{l},k+l),  1*1,..., k, 


Alj  “  lS(J-(j),k+1*J-fi),k+1)^ 


Blj  Alj  ~  (.T-(  1 }  ,  k+1)  ^(.T-f  j  !  ,k+l  *  J— {  i  )  ,k+l ) ~ (J-{ 1 }  ,k+l)  * 
1  <  1  ♦  ^>j  ~  1 , . . . ,k . 


(4.2) 


A1  =  ^S-(J*J.-(i},k+l) 


B1  =  Ai~  (.T-{  1 )  ,k+]  )^(.T*.T-{  !  }  ,k+l )  -  (,T)  *  1  "  1 . k’ 


A0  *  'S(J-J) ' ’ 


R0  =  A0'(j)S(.T-.T)t’(.7)' 


Substituting  (4.1)  Into  (2.3)  yields  the  confidence  region 
for  g  =  0>j .... ,ok) '  as 
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(4.3) 


(e  +  ckV  V?  +  rkV  '  (‘kck^k  "  co)  i  °* 


k  = 

(ci.). 

",th  'll  ■  c1f  Ek* 

(c^ .... ,C^)  ) 

11 

\Ali 

\Rii'  1  =  1 . k’ 

i.1  = 

rtkAi1 

-  vv  1  <  = 

] , . . . ,k, 

1 

7T 

> 

1 

6kBl,  i  =  1 . k. 

0  = 

‘Vo 

vv 

(4.4) 


with  the  A's  and  K's  Riven  In  (4.21. 

The  Inequality  (4.3)  Rives  the  interior  of  a  hyperelllpsold 
k 

In  R  as  the  only  hounded  roRion,  if  the  followinR  two  conditions 
are  satisfied: 


(k) 

Condition  I  :  C^  >  0  positive  definite  and. 

Condition  fT(k):  I),  =  c'C~^c,  -  <:n  >  0. 

k  -k  k  -k  0 


(4.5) 


(the  discriminant  of  the  quadratic  form 
in  (4.3)) 


Lemma  4.2. 


“  lS(k+l«k+l)^S(.!,k+l^T,k+l)l  ^<Ik_Rk'(k+l)S(k+l*k+l)~(k+l)^ 


-1  ^-1 

fak’V~(Jtk+l)S(J,k+l.j,k+l)~(.J,k+l)1 


and 


(4.6) 


Dk  ‘  ‘ I s  1 1 s ( j , H-t  •  j , h-d  ' ( VM  ’ s”'  -  > 


*VPk~  ( J ,  k+1 ) S  ( J , k+1  -.1  ,k+l  )*-(.!, k+  I ) 
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-1 


^S(k+l*k+l)  ^  fak"V,(k+1)S(k+1  •k+l)'- (k+1)1* 


It  follows  that 


r(k> 


(i)  the  Condition  T  Is  equivalent  to 
-1 


ak~Pk-(k+l)S(k+1  L*k+t)~(k+l)  °* 


(11)  D  >  0  1b  equivalent  to 

*  (<) 


Jnk"  V(J,k+l*.I,k+l)S(J,k+l*J.k+l)-(J,k+l)1 
1 


/lak_(V~(k+l)S(k+l ‘k+n-U+l)1  °* 


and  therefore 


(k)  ik> 

(ill)  the  Condition  i  implies  the  Condition  II ' 


We  summarize  in 


Theorem  4.1.  The  100(1 -a)  per  cent  confidence  region  for 

6  *=  (P1»P2» • • • »Pk) ’  is  given  by  (4.3).  This  especially  gives 

the  bounded  region  defined  by  the  interior  of  a  hyperellipsoid 

(k). 


k  (k)  -1 

in  R  ,  if  the  Condition  T  :  V^k+l^k+l-k+l^k+l)  >  0 


00 


Is  satisfied.  The  condition  I  defines  an  acceptance  region 


for  the  test  of  hypothesis  ak+j  ^  0.  The  whole  space  R 

. 1 


represents  the  confidence  region,  if  ak~Bk4^^S^  ^ )-(j)  c 
1  =  1,2,..., k+1,  which  defines  an  acceptance  region  for  the  test 


of  hypothesis  a  =  =  • . .  =  nk+1  =  0.  The  last  part  of 


Theorem  3.1  immediately  generalizes  to  the  present  case. 

We  notice  here  that  the  significance  level  of  the  above  test 


for  the  hypothesis  =  the  critical  region  of  which  is 


(k)  -1 

given  by  the  Condition  I  :  VPVj (k+1  )S(k+l -k+1  .)* (k+1 )  >  °’ 


much  larger  than  n. 


10 


5.  ASSTCNl’D  RATIOS  OV  SEVERAL  COEFFICIENTS :  CASE  TI 
We  consider  the  hypothesis  =  p^» 

a2^ak+2  =  P9.  •  •  •  *‘\/a2k  =  °k  ^  -  2^'  The  L  matT"Ix  ln  (2.4) 

is  given  by  h  =  [ A  , A. .....  A  ,T  ],  where  A.  =  (0, . . . ,0,p  ,0, . . . ,0) * , 

.)  '1  'k  p-k  ~i  l 

the  vector  of  p-k  components  zero  except  the  ith  component  which 

is  p  .  Here  for  simplicity  we  consider  the  case  k  =  2,  l.e., 

1  (2) 

the  hypothesis  :  a^/a^  -  p^»  a2/a^  =  p2* 


Theorem  5.1,  The  100(l-a)  per  cent  confidence  region  for 
(plfP2)  is  given  by 


g21(p2lp])  = 


11-  22  1 


p2+2G, 


>22pl+f:22)p2  +  2(C11 


•2pl+Cl-2pl+C2)p2 


+  (Slpl+2Clpl+<:()) 


(5.1) 


or,  equivalently,  g-^P]  |f>2)  <  where  Ri2^pl^p2^  is  obtained 
from  821^P2^P1^  being  rewritten  as  a  quadratic  form  in  terms 


of  Pj,  where 


Cll*22  “  'S(3,4-3,4)'  [a2  *  f<2~(3,4)S(3,4»3,4)-(3,4)1  * 


Cll*2  =  ^S(2,3«3,4) '  fa2  _  P2<'(3,A)S(2,3*3,4)-(2,3)1, 


Cl»22  *  ^S(l,4-3,4)^a2  “  P2.~(3,4)S(1,4-3,4)~(1 .4)1 
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*  lsn  .?.3.4i  ”  p?~r 


-1 


Jl-2  .  (1.2-3, 4) 


2~(3,4)‘‘(1  ,2-3,4)~(l,2)^  * 


1S(2, 3-2, 3)^2  ‘  P2‘,(2,3)S(2,3-2,3)~(2,3)1,  (5,2) 


C22  “  lS(l, 4-1,4) ^[a2  "  V?(1,4)S(1,4-1,4)~(1,4)1 
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-1 


'S(1.2*2,3) ' fa2  "  P2'(2,3)S(l.2.2.1)'(l,2)1 


C2  “  'S(l, 2*1,4)  ^fa2  "  P2t-(I,4)S(1,2*1,4)~(1,2)1, 


C0  =  lS(l,2*lt2)^a2  ~  B2'(1,2)S(1,2*1,2)-(1,2)5 


(5.1),  In  general,  defines  asymmetric  regions  on  the 
((>1  •  1’ 2 )  1'^ ;,m> •  The  boundedness  of  the  region  (5.1)  Is  equi¬ 

valent  to  the  condition  that  there  is  no  solution  of  (5.1)  at  the 
infinite  points, namely , 


2 


^11*22()  I  ^  ^^1 .22()1  ^22  ^  ^  for  any 


(5.3) 


and 


^ll*22p2  +  ^11*2^2  +  ^"11  >  ^  ^or  any  p2* 


(5.4) 


which  are  respectively  equivalent  to 


and 


n2  '  P2'(3)S(3*3)'(3)  >  ° 


a2  "  P2~(4)S(4*4)~(4)  >  °’ 


(5.5) 

(5.6) 


Theorem  5.2.  The  confidence  regions  (5.1)  are  bounded  when  the 
conditions  (5.5)  and  (5.6)  are  both  satisfied.  These  conditions 
define  an  Intersection  of  rejection  regions  against  the  tests  of 
hypotheses  a^  =  0  and  a^,  =  0.  The  last  part  of  Theorem  3.1 
immediately  applies  to  the  present  case. 

6,  ILLUSTRATIONS 

We  shall  illustrate  the  confidence  regions  considered  in  the 
previous  sections,  using  the  well  known  data  of  Fisher  (1938). 

The  data  consists  of  50  observations  each  with  four  characters, 
sepal  length  (>^),  sepal  width  ,  petal  length  (x^)  and  petal 


-.xuawm 
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width  (x^)  in  two  species  of  plants  Iris  versicolor  and  Tris 
setosa.  We  utilize  the  tables  of  observed  mean  values  and  co¬ 
variances  shown  in  Rao  (1970a,  Chapter  7,  Section  7b. 3)  in  oar 
computation.  The  sample  coefficients  of  the  discriminant  function 
are  given  by 


a1  =  -3.06')?,  fl2  =  -18.0006, 


.1,  -  21.7641  .  A,  =  30. 7549. 
J  4 


(6.1) 


Fig.  1,  shows  the  97.5%  and  99.5%  confidence  regions,  given 
by  (4.3)  with  k  =»  2,  for  p^  =  Oj/a^  and  p2  •*  The 

point  of  the  sample  ratios  <5 j  =  A  /fl  and  *  Aj/A^  with  the 
A.,  i  ■  1,2,3,  given  by  (6.1)  is  plotted  for  reference.  It  is 
noted  that  the  values  of  j)S(3*3)~  (3)  are  P°8***ve  f°r 

both  cases.  Fig.  2  shows  the  97.5%  and  99.5%  confidence  regions, 

given  by  (5.1),  for  p^  «  al^a3  an(1  p2  =  a2^a4‘  The  po*nt  of 
the  sample  ratios  =  Aj/a^  and  f>2  =  Aj/A^  with  the  A^, 

1  ■  1,...,4,  given  by  (6.1)  is  plotted.  Here,  the  values  of 

a2  **  ®2'(4)S(4*4)'(4)  nre  P08**^6  for  the  c»se  of  97.5%  and 
negative  for  the  case  of  99.5%,  and  the  values  of 
aj  -  ®2'(3)S(3* 3)~(3)  are  Posltive  f°r  both  cases. 
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FIG.  1.  Confident**  regions  for  ^  /•"'•j  and  Pj  ■ 

(1«)  '•  7 . %£  confidence  region 

(1h)  I1*. S7.  confidence  region 

FIG.  2.  Confidence  regions  for  and  p2  "  a2^a4 

(2n)  97.SI  confidence  region 

(2h)  *>9.r>2  confidence  region 
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